Asymptotic normality of robust M-estimators with convex penalty
نویسندگان
چکیده
This paper develops asymptotic normality results for individual coordinates of robust M-estimators with convex penalty in high-dimensions, where the dimension p is at most same order as sample size n, i.e, p∕n≤γ some fixed constant γ>0. The requires a bias correction and holds M-estimator large class loss functions including Huber its smoothed versions regularized strongly penalty. variance that characterizes width resulting confidence intervals estimated data-driven quantities. estimate adapts automatically to low (p∕n→0) or high (p∕n≤γ) dimensions does not involve proximal operators seen previous works on M-estimators. For loss, has simple expression involving an effective degrees-of-freedom well size. case Elastic-Net studied details simulation study confirms theoretical findings. follow from Stein formulae high-dimensional random vectors sphere developed which are independent interest.
منابع مشابه
Statistical consistency and asymptotic normality for high-dimensional robust M-estimators
We study theoretical properties of regularized robust M -estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavytailed distributions and/or outliers in the additive errors and covariates. We first establish a form of local statistical consistency for the penalized regression estimators under fairly mild conditions on the error distributio...
متن کاملAsymptotic Normality for Deconvolving Kernel Density Estimators
Suppose that we have 11 observations from the convolution model Y = X + £, where X and £ are the independent unobservable random variables, and £ is measurement error with a known distribution. We will discuss the asymptotic normality for deconvolving kernel density estimators of the unknown density f x 0 of X by assuming either the tail of the characteristic function of £ behaves as II I~Oexp(...
متن کاملTowards the study of least squares estimators with convex penalty
Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not fully satisfying since it allows one to prove oracle inequalities with fixed high probability only for the estimators depending on this probability. Furthermore,...
متن کاملAsymptotic Normality of Kernel Type Density Estimators for Random Fields
Kernel type density estimators are studied for random fields. It is proved that the estimators are asymptotically normal if the set of locations of observations become more and more dense in an increasing sequence of domains. It turns out that in our setting the covariance structure of the limiting normal distribution can be a combination of those of the continuous parameter and the discrete pa...
متن کاملAsymptotic Normality and Efficiency of Two Sobol Index Estimators
Introduction 1 1. Definition and estimation of Sobol indices 2 1.1. Exact model 2 1.2. Estimation of S 3 2. Asymptotic properties: exact model 4 2.1. Consistency and asymptotic normality 4 2.2. Asymptotic efficiency 6 3. Asymptotic properties: metamodel 8 3.1. Metamodel-based estimation 8 3.2. Consistency and asymptotic normality 8 3.3. Asymptotic efficiency 11 4. Numerical illustrations 12 4.1...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2022
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/22-ejs2065